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ABSTRACT 


This narrative review focuses on the conceptual learning cycle and covers the key practical aspects of reflecting on personal career 
development, deciding on the most appropriate learning experiences to undertake and self-assessment to successfully fill learning gaps. 
We a) describe the rationale behind the systematic learning cycle, b) explain a practical model of conducting an effective continuing 
professional development (CPD) plan under the physician perspective, c) summarize methods of gap analysis and needs assessment, 
learning methodologies, and assessment strategies suited to the physician educational practice. We conclude by expressing our own 
views on the topic within the broad frame of the CPD stakeholders' multiple perspectives. 
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RESUMO 

Esta revisão narrativa centra-se no conceito do ciclo de aprendizagem e aborda os principais aspectos práticos sobre o desenvolvimento 
da carreira profissional sugerindo as experiências de aprendizagem mais apropriadas para conduzir e autoavaliar com sucesso o 
preenchimento das lacunas de aprendizagem identificadas na prática clínica. No artigo apresentamos: a) a descrição do racional 
subjacente ao ciclo sistemático de aprendizagem, b) a explicação de um modelo prático para a condução de um plano de desenvolvimento 
profissional contínuo (DPC) sob a perspectiva do médico especialista, c) um resumo dos métodos analíticos de lacunas na prática 
clínica e da avaliação de necessidades, de metodologias de aprendizagem e de estratégias de avaliação mais apropriadas em educação 
médica contínua e desenvolvimento profissional. Concluímos expressando os nossos pontos de vista sobre o assunto no contexto 
das múltiplas perspectivas das várias partes interessadas no DPC. 
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RESUMEN 


Esta revisión narrativa se centra en el concepto del ciclo de aprendizaje y aborda los principales aspectos prácticos sobre el desarrollo 
de la carrera profesional sugiriendo las experiencias de aprendizaje más apropiadas para conducir y autoevaluar con éxito el Ilenado de 
las lagunas de aprendizaje identificadas en la práctica clínica. En el artículo presentamos: a) la descripción del racional subyacente al 
ciclo sistemático de aprendizaje, b) la explicación de un modelo práctico para la conducción de un plan de desarrollo profesional continuo 
(DPC) desde la perspectiva del médico especialista, c) un resumen de los resultados métodos analíticos de lagunas en la práctica 
clínica y de la evaluación de necesidades, de metodologias de aprendizaje y de estrategias de evaluación más apropiadas en educación 
médica continua y desarrollo profesional. Concluimos expresando nuestros puntos de vista sobre el tema en el contexto de las múltiples 
perspectivas de las distintas partes interesadas en el DPC. 


Palabras Clave: Educación Médica Continua; Evaluación; Aprendizaje. 
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Effective CPD Learning Experiences 


INTRODUCTION 


In times of medical knowledge explosion and rapid obsolescence, greater society scrutiny, increasing public 
demands on the medical profession, and heavy professional workload in complex healthcare systems, gauging the 
effectiveness of learning events has become central in continuing professional development (CPD). The learning 
cycle underpins undertaking CPD and attending CPD learning events. Demonstration of outcomes is key after 
participating in CPD activities. In this paper, we review the methods enabling the physician to achieve improved 
outcomes from CPD learning events, including 1) conducting a needs assessment based on learning gaps 
identified in practice, 2) creating effective goals and objectives to guide the personal learning plan, 3) matching 
the appropriate learning formats to bridge the desired outcomes and the learning needs previously identified, and 
4) assessing the outcomes derived from the undertaken learning activities. These should effectively underpin on 
the personal development plan, which is anchored on the following three cyclic professional questions: What will 
| learn? How will | learn? and How well have | learned? This subject has been reviewed in general, but in this 
article, we focus on the needs of the learner rather than the CPD educator and extrapolate from a wider medical 
literature because there is minimal ophthalmology-specific literature. We use the term CPD throughout as the 
process of continuing education that is individualized for each ophthalmologist and aims to develop all the clinical 
and nonclinical competencies required by practicing ophthalmologists. 


LEARNING CYCLE 


CPD can be considered as a part of the continuum of medical education, arguably the most important phase, 
as itlasts the duration of one's professional career. After completing medical school and training in ophthalmology, 
CPD learners are adult learners and are expected to be proficient in reflection and self-directed lifelong learning, 
although this may not always be the case. CPD learners are expected to follow the principles of adult learning: 
and be driven by 1) the need to know, 2) the learner's self-concept, 3) the role of the learners' experiences, 4) 
the readiness to learn, 5) the orientation to learning, and 6) motivation.º 

Adult learners follow the learning cycle (Figure 1). The learning cycle begins with setting individual goals 
derived from reflecting upon one's own current practice ffom which gaps can be identified, leading into a learning 
needs assessment going on with planning on how to meet learning needs. Appropriate CPD activities, either in 
format or in content, are then undertaken, and the outcomes from these activities should be assessed. A further 
cycle begins after reviewing the outcomes in relation to goals, and thus, repeated learning cycles occur during 
a professional career. 

In the ophthalmic practice, physicians' goals should meet one's own healthcare organization, and systems 
needs and major stakeholders influence the goals of CPD. Medical regulators and professional ophthalmology 
societies, including the Conselho Federal de Medicina and the Brazilian Council of Ophthalmology, set standards 
for competent practicing ophthalmologists. 


1) Conducting a needs assessment 

In this step, physicians reflect upon their current practice compared with the ideal practice, identify the gaps, 
and perceive learning needs. Learning needs may as well be misperceived when the gap is not clearly recognized 
by the physician or even unperceived and become only apparent by external evaluation. Emerging learning needs 
associated with new techniques and concepts urge the physician to activate the personal development plan. 

A needs assessment relies on the self-question What will | learn? Information can be obtained by self- 
assessment or from external sources of data. As mentioned above, self-assessment can be either an individualized 
process of self-reflection or via self-administered tests such as those provided by the American Academy of 
Ophthalmology and Internet sites such as Medscape. Unfortunately, reflective self-assessment by medical students 
and physicians is known to be inaccurate, with overinflated and underinflated assessments being common. The 
phenomenon of the most unaware individuals having the most overinflated self-assessment is recognized as the 
Kruger-Dunning effect. Medical students tend to begin with overinflated self-assessments, with gradual lowering 
to underassessment throughout their medical student years, and there is some evidence showing that medical 
school may worsen rather than improve the ability to self-assess by reflective practice.!º 

In this context, it is important to have external sources of information, and some of these are recorded in 
Table 1. There are limited data on the most effective sources of external data in conducting a needs assessment. 
Parboosingh surveyed CPD participants on their opinion of data sources most likely to change practice and found 
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Professional Goals 
and Objectives upon 
identified Gaps 


Reflection in and on Practice 


How well have | 
learned? What will | learn? 


Results of learning activities How to meet learning needs 


How will | learn? 


Plan and Undertake a range of 
activities 


Figure 1. Adult learning cycle. Adults developing a learning cycle pass through several stages. They can depart 
from reflecting in and on individual professional practice, recognize a gap, and assess own learning needs to 
answer the question What will | learn? They react planning for events (How will | lgarn?), undertaking them (when 
self-questions can prompt increased effectiveness of the event) and assessing effectiveness of learning events, 
which have been undertaken (How well have | learnt?). Ideally, the results of evaluation then prompt another 
learning cycle and thus a process of continuing improvement. 


surgical audit and post hoc review of management of groups of patients to be judged as the most effective. In 
contrast, taking standardized tests and traditional continuing medical education (CME) activities were judged to 
be ineffective in changing practice and by implication in informing a needs analysis. 

External sources of data are important in conducting a gap analysis, but not all data can be objectified. In 
addition, constantly emerging new information and computer-generated huge banks of data prompt the physician 
to continuously probe the environment and process, manage, and apply in practice new knowledge in accordance 
to customized needs. Physicians need to have an eye on the future and be prepared to undertake learning needs 
assessment relating to new technologies for diagnosis, new medications, innovative treatments, and regulatory 
changes, which may impact patient care. 

Ophthalmologists should record needs analyses, as well as the results of their learning activities. A self- 
reflective portfolio is useful as it allows recording of needs analysis and subsequent learning activities. Reflection 
on results, analysis of one's learning style, and information about patient outcomes and health system needs can 
all be recorded in an individually designed portfolio. Concerns have been raised regarding the unintended use of 
documentation of reflective suboptimal performance, insecurities, or poor patient outcomes for legal purposes. 
The Academy of Medical Royal Colleges has thus written guidance on physicians” entering reflective notes into 
their individual e-portfolios. 


2) Creating goals and objectives 

In this stage, adult learners ideally plan and create a strategy and seek resources to achieve their learning 
goals. Rosenblum and Darkenwald found that participation in course planning by nurse supervisors did not 
improve learning outcomes. A recent study of rneumatologists undertaking self-assessment tests on Medscape 
demonstrated improved outcomes for those whose personalized program activities were geared by their tests' 
outcomes when compared with those following a self-directed learning plan disregarding that guidance. 
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Table 1. External sources of data which can be used to inform a personal needs analysis. 


Assessor Possible data sources 


Standardized tests e.g. American Academy of Ophthalmology (AAO) ONE Network", Medscape? 
Personalized surgical audit results 
Self-assessment Audit of medical records e.g. AAO Office Record Reviews 
Morbidity-mortality meetings 


Interesting patient encounters 


Complaints 
Patients? Patient satisfaction surveys 


Part of multisource feedback 


Morbidity-mortality meetings 
Peers Informal feedback based on patient outcomes 


Part of multisource feedback 


CPD teachers Pre- and post-test questions in CPD activities 


Identified as outlier 
Medical regulators & hospital administrators 
Patient complaints 


Surveys of trainers?435 
National training bodies Identified as outlier 


Patient complaints 


National health data 
National health projects e.g. women's eye health 
Community 
Leaning gaps identified by nationwide big data projects e.g. AAO IRIS project 


Community relationship with medical schools?* 


We believe that by clearly defining their goals and objectives, physicians will assess more effectively the 
outcomes generated by undertaking learning experiences. Setting goals help to define the purpose to undertake 
a particular CPD program. Furthermore, defining objectives that are specific, measurable, attainable in realistic 
conditions, relevant to practice, and time-framed is tied to a more efficient outcome assessment with a rewarding 
sense of achievement, professional progression, and job satisfaction. The characteristics of learning objectives 
can be translated into the acronym SMART (specific, measurable, attainable, relevant, and time-framed). When 
recording the personal development plan in the self-reflective portfolio to demonstrate professional engagement 
and accountability, the physician should clearly document the individual goal and objectives leading to undertake 
a specific CPD program. 


3) Matching delivery formats 

In this stage, physicians act to undertake activities, which they have selected as most appropriate to fill 
their learning gaps. This requires understanding of the effectiveness of various CPD activities and the use of 
strategies to optimize learning and has been referenced in the American Accreditation Council for CME criterion 
5 for CME activities. 

Several studies demonstrate that traditional CME lectures can be ineffective learning experiences. 
Furthermore, Legaré et al. demonstrated that the vast majority of offered CPD activities do not target higher orders 
of thinking and instead focus on low levels of learning, as facts. Using the modified taxonomy of Bloom, it was 
shown that the offered activities are most often at level 1, rather than levels 5-7, where analysis and creation of 
new learnings occurs. These activities would not be expected to be capable of generating new competencies in 
ophthalmologists who undertake them. 

While practicing, formal and unplanned learning experiences occur and should be valued. International 
bodies such as UEMS (Union Européenne des Medecins Spécialistes/European Union of Medical Specialists) 
through the EACCME (European Accreditation Council for Continuing Medical Education) have recognized 
learning through examining, peer reviewing, teaching, and e-learning as eligible for CPD activities. Healthcare 
systems technology (electronic health record) enables retrieval and analysis of patient data to inform shared 
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decision-making with the patient. Available clinical data work as rich digital libraries always ready to provide 
directed information to be processed and applied.? 

On the other hand, to substantiate facilitation of new learning for the practicing physician and justify formal 
CPD programs as effective learning experiences, increasing requirements have been set. The growing clinical 
workload and funding challenges have created an emphasis to develop cost-effective CPD programs. This demands 
CPD educators, who form the most diverse faculty group of all medical education stages, to have augmented 
teaching skills in applying the elements of the learning cycle. 

The most effective CME learning experience is probably the clinical audit and feedback on professional 
behavior and patient outcomes. A Cochrane review found that audit and feedback are most effective when health 
professionals are not performing well to start out with; the person responsible for the audit and feedback is a 
supervisor or a colleague; it is provided more than once; it is given both verbally and in writing; and it includes 
clear targets and an action plan. The Cochrane review authors concluded that it is uncertain whether audit and 
feedback increase effectiveness when combined with other interventions.?* There is evidence indicating that CPD 
activities are most effective when they are undertaken over multiple occasions, with interactivity, and in different 
formats.º 

Ophthalmologists often may not have the resources to undertake surgical audit of their practice. Instead, they 
must use available learning experiences to their best advantage, which typically involve planning and reflecting 
on learning. Table 2 lists typical CPD learning experiences and self-questions, which the ophthalmologist can 
ask prior to and during the learning experience, as well as recognized techniques, which participants may ask of 
educators to improve the quality of teaching. 


4) Assessing effectively 

The closing phase of the learning cycle is to assess the professional practice outcomes of having undertaken 
a specific learning experience. What behavior change does the physician recognize to have brought change in 
practice with consequent improved patient outcomes? What impact on the organization's performance does the 
physician identify as associated? Undertaking a learning experience can be justified by a self-confidence boost to 
practice an ongoing technique. New learning will be consolidated by reinforcement (practice) and dissemination 
(sharing with peers and coworkers) in further opportunities to be found in practice. By participating in interactive 
and longitudinal programs with feedback, physicians can build meaningful knowledge and skills to effectively 
translate into practice. 2 

Don Moore has proposed a pyramidal ffamework for the assessment of continuing education, beginning with 
event participation (level 1) and concluding with assessment of community health outcomes (level 7) (Figure 2). 

For accuracy and transparency purposes, physicians' self-assessment should be complemented with 
assessment of external evidence. The ideal outcomes for assessing CPD effectiveness are Moore's levels 6 and 
7 relating to individual patient and society health outcomes. However, this relationship is difficult to demonstrate, 
and these levels are still seldom used in broad practice. Probably, the most pragmatic method of demonstrating the 
effectiveness of CPD activities is by observing performance change in practice. In ophthalmology, this strategy has 
been pursued at the postgraduate level by making use of either direct or video observation procedural skills and 
behavior. To our best knowledge, evidence on the use of such strategy in CPD is scarce though it is considered 
in ACGME criterion 30 as the best practice CME design to optimize technical and procedural skills of learners. 


DISCUSSION AND CONCLUSION 


After postgraduate training, and as a practicing specialist, medical education continues as a personalized 
CPD, targeting the individual's learning needs and aspirations while meeting the workplace and the regional 
community healthcare needs, within the necessary skills and attributes of the contemporary ophthalmologist. CPD 
learners are time-poor and need to optimize their time spent on CPD activities. Time is best spent according to 
the adult learning cycle, by systematically undertaking a gap analysis and needs assessment, deliberate planning 
for learning experiences to be undertaken, and assessing the effect of CPD activities on professional practice 
change. The learning cycle is anchored in the following three sequential questions: What will | learn? How will | 
learn? and How well have | learned? We can infer a dynamic framework in which going back in the cycle to rethink 
a more suited option within each step is possible to effectively progress and close the loop to start a new cycle. 
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Table 2. Methods to improve the effectiveness of a range of typical CPD activities. Self-questions are shown as part of planning to undertake and 
during CPD activities. The table also illustrates questions, which participants may ask of instructors, and tips for instructors, which may enhance the 


effectiveness of events. 


CPD Activity 


Planning 


Monitoring 


Methods for instructor to improve 
learning 


Didactic lecture/large group 


What do | know about this topic? 
What questions do | have about this 
topic? 

How does this topic fit into the CME 
curriculum? 


What insights am | having during the 
lecture? 
What questions are arising for me 
during the class session? 


Faculty present in interactive way, 
aided by available technology. 
Faculty present cases and model 
problem-solving thinking. 
Breaking large group to small groups 
for discussion. 

Provision of enabling handouts. 
Check for understanding by asking for 
questions.?” 

Flipped classroom: students pre- 
read factual material, and instructor 
presents cases based on pre- 
reading.* 


Interactive workshop (practical 
application focus) e.g. instruction in 
intravitreal-injection 


What preparation do | need (pre-test, 
patient reviews)? 


What is challenging to me about the 
workshop activities? 

What other resources could | use to 
complete the activity? 


Patient based (live, standardized, 
recorded, mannequins, virtual reality, 
role plays) 


Small group learning (typically 10 or 
fewer participants) e.g. resident case 
presentations, rounds, morbidity- 
mortality meeting 


Which patients have | recently found 
challenging to manage? 
Which literature do | need to review 
prior to the meeting? 


Do | understand the reason for my 
patient's poor/good outcome? 


Instructor models problem-solving 
thinking. 
Instructor presents similar cases.*º 


Clinical audit 


Which patient outcome do | need to 
review? 
What is the appropriate benchmark? 


Am I collecting appropriate patient 
information? 


During presentation of audit findings: 
How do my findings relate to the 
standard of care? 

How can | improve my patients” 
outcomes? 

What helpful feedback have my peers 
given me? 


MOC or similar examination 


What study strategies will | use (study 
groups, practice quizzes, review 
sessions)? 

Which material should | spend more/ 
less time on? 


To what extent am | using all the lear- 
ning supports available to me? 


Not applicable 


Attend entire conference 


What do | want to learn at this 
conference? 
What questions do | already have 
about the conference theme/subs- 
pecialty? 


What could I do to increase my in- 
terest? 
How did | prioritize the information 
provided to me? 


Not applicable 


Informal self-directed, point-of-care 
learning 


Are my patients booked at appropria- 
te intervals to allow enough time for 
thinking? 


What supports my clinical decision? 
What literature/guidelines do I need 
to review during the consultation? 


Not applicable 


Part of the ancient hidden social contract of medical profession is that physicians should maintain self- 
awareness of their knowledge and skill needs and address these by their lifelong learning commitment. We are 
confident that by recognizing this as an ongoing continuous process, physicians can, for example, demonstrate 
that medical profession effectiveness relies on continuing education and professional development. Society 
representatives, regulators, policymakers, employers, and administrators in leading positions should embrace 
leadership in promoting physician CPD, as essential to guarantee and improve the healthcare of communities. 
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Figure 2. Moore's proposed CME outcomes pyramid.% Traditional continuing medical education (CME) is focused 
on levels 1-3 and, at best, assesses learning in pre- and post-tests. Continuing professional development aims 
toward assessing level 5, performance in practice. Ideally, the outcomes of CPD are demonstrated by improved 
health of patients and the community, but this represents the exciting challenge to ideally align and bring together 
in exceptional fluent coordination the goals, communication, and actions of all CPD stakeholders. 
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